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*2.8 Continuity at the boundary for exponential families. Let {Pe, ^ e 6} be an 
exponential family where is the natural parameter space and for some cr-finite measure 

{dPe/dii){x) = C{e)exp{e-T{x)). 

Then 1/C{e) = K{0) = /exp(^ ■ T{x))dfi{x). In Theorem 2.5.8 we saw that K{e) is a 
highly regular (analytic) function on the interior of 0. Points on the boundary of 
may or may not be in 0. If they are, then differentiability properties would not hold in 
directions leading outside of 0, although they might hold in directions leading into 0. This 
section will treat the question whether the function K (and so C) is at least continuous at 
boundary points that happen to be in 0. There will be one positive result, then a negative 
one and a counter-example. 

Recall that the convex hull of a set A of points in a vector space is the smallest convex 
set including A. If A is a finite set, A = {ai, afc}, then it is easily seen that the convex 
hull of A is the set of all sums Xlj=i ^j'^j where Xj > for all j and Xlj=i ~ 1- T^^^ 
convex hull of a finite set is a closed interval in M^, a convex polygon in M^, and a convex 
polyhedron in for d>S, whose vertices are some of the aj (other may be contained 
in the convex hull of aj for j ^ i). 

A convex function on a closed interval is not necessarily continuous at the endpoints: 
for example let /(O) — /(I) = 1 and f{x) = for < a; < 1. Then / is convex on [0, 1]. It 
turns out, though, that this kind of discontinuity on an interval can't happen for functions 
K{-) (a closed interval is the convex hull of its endpoints): 

2.8.1 Theorem. Whenever a finite set of points, F = {^i,... ,0k}, is included in the 
natural parameter space 0, K{-) and C(-) are both continuous on the convex hull H of F. 

Proof. By Theorem 2.5.6, is convex, so it includes H. By Jensen's inequality (RAP, 
10.2.6), for any 9 e H, so 9 = Yl'j=i ^j^j where Aj > and Yl^=i — 1; 

exp(^-T) < Ej=i exp(^j • T) < exp(^i • T) + • • • + exp(^fc • T). 

By assumption, the function on the right is integrable for /x, while the function on the left 
is continuous in ^. It follows by dominated convergence that K{-) is continuous on H. 
Since K{9) > for all 9, C(-) is also continuous on H. □ 

If F is in the interior of 0, then we have even stronger regularity properties of K{-) 
on H by Theorem 2.5.8. So Theorem 2.8.1 is of interest only when at least one 9i is on the 
boundary of 0. For example, if two of the 9i are on the boundary, then the line segment 
joining them is included in the boundary and K{-) is continuous along such a line segment 
and also as the segment is approached from within H. 

For any exponential family of order 1, is an interval (which may be open or closed 
at each end). If either endpoint is in 0, K{-) is continuous there, so K{-) is continuous 
everywhere on 0. The situation can be different for families of order 2 or higher, as follows. 
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2.8.2. Proposition. For any exponential family with natural parameter space 0, if 9o 
is a point in G, on its boundary, which is a limit point of points on the boundary of 
which are not in 0, then K{-) is not continuous at 9o on Q. 

Proof. By Fatou's Lemma (RAP, 4.3.3), K{9) must approach +oo as 9 approaches (f)j 
from within for each j. Let 9j for j > 1 be a point of at distance less than 1/j from 
(f)j such that K{9j) > j. Then 6*^ ^ 6*0, so K(-) is not continuous at 6*0. □ 

Now, it will be shown that the situation in the last proposition can actually occur. 

2.8.3 Proposition. There is an exponential family of order 2 with natural parameter 
space = {(i/;, (/)) G . ^ > o, > 0} U {(0, 0)}. Thus the function K{-, •) for the family 
is not continuous at (0,0). 

Proof. Let -P(,/,,<^) have density Ci^ifj, 4')e~'^^~^y with respect to the measure ^ := Hi + fX2 
on defined by diJ,i{x,y) — dx/{l + x^) on the curve x > 0, y — —^/x and diJ,2{x,y) = 
dy/(l + y^) on the curve y > 0, x = —^/y. Evidently the family is exponential as in (2.5.3), 
with T(x,y) = {—x,—y). The measure fj, is finite, so (0,0) G 0. For any > and 
0>O, 

/■oo 

/ e-^^+'^^da;/(l + a;^) < oo, 
Jo 

and likewise for ^2- For t/j = < (p, e'^^dx/{l + x'^) = +oo, and likewise for (p = < t/j 
and //2- Clearly {ip, 0) with '0 < or < are not in 0, so it is as described. Since (0, 0) 
is in and is a limit of points in the boundary of not in 0, K{-, ■) is not continuous on 
at (0, 0) by Proposition 2.8.2, completing the proof. □ 

Note that for the example in the last proof, for any 5 > 0, -ftT (V', </>) is continuous as 
ip 10 and i through a region Sip < (j) < ip/S, by Theorem 2.8.1, but K is not continuous 
at (0, 0) along some curves tangent to the vertical or horizontal axis. 
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PROBLEM 



1. If the natural parameter space © of an exponential family of order 2 is the open unit 
square together with parts of its boundary as follows, at what points of is K{-) 
restricted to continuous? Explain. 

(a) = {0 < ^1 < 1, < ^2 < !}• 

(b) = {0 < ^1 < 1, < ^2 < !}• 

(c) = {0 < ^1 < 1, < ^2 < 1} U {0 < ^1 < 1, 6*2 = 0}. 

2. (a) For any exponential family, show that the natural parameter space is an Fcr, that is, 
a countable union of closed sets. Hint: show that for any n = 1,2, {9 : K{9) < n} 
is closed. 

(b) For the natural parameter space as in Proposition 2.8.3, find explicitly a sequence 
of closed sets F„ whose union is (not by way of part (a)). 

(c) Show that any convex set in whose interior is the same as that of in Propo- 
sition 2.8.3 must necessarily be an F^-. 

NOTES 

Barndorfi'- Nielsen (1978) calls an exponential family "regular" if its natural parameter 
space is open. It is not difficult to give examples of exponential families for which has 
non-empty boundary and is closed (an example of order 1 is given in Section 3.2 below). I 
assume that the results of this section are known but at this writing I do not have literature 
references for them. 
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